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Abstract 

We study the same-sign top pair production mediated by the first Kluza-Klein (KK) excitation 
of the gluon in the Randah-Sundrum (RS) model with flavor violation at the Large Hadron Collider 
(LHC), in which the nonuniversal couplings between fermions and KK gauge bosons will lead to 
observable tree level flavor-changing neutral current (FCNC) effects. We find that the same-sign 
top quarks produced in our case have property of high energy and high transverse momentum, and 
lead to an observable signal in the same-sign dilepton channel even when the mass of the KK gluon 
reach up to 3 TeV. We further investigate the potential of the LHC to probe the flavor violating 
parameters and find that the LHC can probe their values down to 0.06. 
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I. INTRODUCTION 



Now search for extra dimensions has been one of the major objects at the LHC, since 
its physical effects can appear at the TeV energy scale. The idea of extra dimensions was 
revived in the 1990 's , which brings new solutions to the gauge hierarchy problem 

and also can be used to resolve the fermion mass hierarchy problem. The RS model |3| with a 
warped geometry in five dimensions is one of the most important cases. In the RS model, the 
single extra dimension is compactified on a S^/Z2 orbifold with a radius r, which is not too 
large compared with the Planck length. Two 3-branes, the Planck brane and the TeV brane, 
are located at the orbifold fixed points = 0, vr, respectively, and the spacetime between 
the two 3-branes is simply a slice of a five-dimensional anti-de Sitter (AdSs) geometry. The 
five-dimensional warped metric is given by 

ds^ = e-^'^'^'t'^rj^^dx^'dx'' - r'^dcj?, (1) 

where (f) is the five- dimensional coordinate, and k ~ Mp is the curvature scale. By requiring 
kr ~ 12, one can suppress the Planck scale to Mpe~^'^'^ ~ O(TeV) on the TeV brane, and 
then solve the gauge hierarchy problem. 

The original RS model has also been generalized to allow the standard model (SM) fields 
to .es,de in the ta.. mMm, wKich can generate the fenn,on n,a3s Me..a..eK. by 
exponential warped factors. For each fermion fiavor z, we have two five- dimensional Dirac 
fermions \E'j^L(x, y), and \E'j^/j(x, y), {y = r(f)), while for simplicity the Higgs field will be 
localized on the TeV brane. Thus, the Yukawa coupling of bulk fermions can be expressed 
as Q 

j d^xdy^xf^ {H{x)^i^L{x, y) + h.c.) 5{y - vrr) 

^ j d'xK, {H{x)¥;i{x)^>fl{x) + h.c. + ...) , (2) 

where A-^ are the five- dimensional Yukawa couplings and Ajj are the effective four- 
dimensional Yukawa couplings between the Higgs fields and the SM fermions, \I'-^'' and 
^^j'p^ which correspond to the zero KK modes. If each fermion field has a 5D bulk mass, 
which can be parameterized as Mf(^ij)(^L,R) = kc(^ij)(L,R), then we can obtain [7| 

A^'^fc 

\ _ (l-CiL-Cjii)nkr (o\ 
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with 

J_ ^ 1/2 - C^L 

and similarly for Njn- For light fermions, by setting cnyCjn > 1/2, which means the 
light fermions are localized towards the Planck brane, one can generate exponentially-small 
Yukawa couplings. On the other hand, the third generation quarks can be close to the TeV 
brane and have 0(1) Yukawa couplings by requiring CiL, CjR < 1/2. 

Since the light fermions live towards the Planck brane, their couplings to KK gauge 
bosons will be small and universal. But for the right-handed top quark and the left-handed 
doublet Q^, they could have rather strong couplings to the KK gauge bosons [3, These 
nonuniversal couplings will lead to observable FCNC effects at tree level, which have been 



extensively studied in Refs [U 



In the SM, the same-sign top pair production rate is highly suppressed due to the GIM 
mechanism, but can be enhanced to an observable level in some new physics models, for 
example, supersymmetric standard model jisl, topcolor-assisted technicolor model [l4|, and 

same-sign top pair can also be produced with the 
model-independent FCNC couplings, gtq, Ztq, 'jtq, Htq and Z'tq [iG^. All these processes 
can provide very clean signals due to the small SM backgrounds for the same-sign dilepton 
channel. In this paper we study the same-sign top pair production mediated by the first KK 
excitation of the gluon, G^^\ at the LHC and use this process to directly probe the FCNC 
couplings between the up-type quarks and the first KK gluon. And we show the production 
rate can be greatly enhanced due to the large FCNC couplings of the up-type quarks and 
the KK gluon. 

The arrangement of this paper is as follows. In Sec. II, we give the relevant FCNC 
couplings and parameters. In Sec. Ill, we show the cuts for signal selection and numerical 
results. Sec. IV contains a brief conclusion. 



II. FCNC COUPLINGS 

In general, the top FCNC couplings in our case can be written as 
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where gt^, gtj^ are the couphng constants between top quark and G^^\ and Ul, Ur are the 
left-handed and right-handed rotation matrices that transform the up-type quarks from the 
weak eigenstate basis to the mass eigenstate basis. Other contributions from the first two 
generations can be neglected due to the smallness of the coupling constants. As pointed 



out in Refs. 



19 



20|, a KK gluon with mass Mq^i) as low as 1 TeV is still possible, 



so we will consider MqH) values from 1 TeV to 3 TeV below. Within this mass range, the 



authors of Ref. 



Uj discuss some interesting values of c| and which can generate the 



correct quark masses, mixings and also satisfy all the electroweak precision constraints, and 
give a possible range of the coupling constants, gt,^ = [1.0, 2.8](7s5 dtn = [l-5,5](7s, where gs 
is the usual 4D strong interaction coupling constant. 

The rotation matrixes Ul and Uji depend on the 5D Yukawa couplings and the bulk 
masses of the up-type quarks. In principle, we have little knowledge on the matrix elements, 
and the choice of their values has a great freedom. However, in order to generate the 
correct Cabibbo-Kobayashi-Maskawa (CKM)^ matrix, we have Vckm = uIDl- By assuming 
Ul ~ VVcKM, U^L ^l" '^^^y small [11], so we will neglect the contributions from the 
left-handed FCNC couplings in our following calculations. On the other hand, there is no 
direct constraint on the elements of Ur, so we treat U^^ Ur and Ur as free real parameters 
as in Ref. HI], and investigate the LHC reach of the parameter region. 

The relevant Feynman diagrams for same-sign top pair production are shown in Fig. [H At 
the LHC, the main contribution to the same-sign top pair production arises from subprocess 
uu tt due to the high parton luminosity of the u quark. However, in order to probe ?7^, 
we also include contributions from the subprocesses mc, cm, cc tt. We define two flavor 
violating parameters Su = \UrUr\, and Ec = \UrUr\, which must satisfy el + < 0.5^ due 
to the unitarity of Ur. Note that our study is almost model-independent and depends only 
on Eu, £c, gtR and Mq{i). In our numerical calculations, the CTEQ6L1 PDF set [21] is used, 
and renormalization and factorization scales are set to the top quark mass. 

In Fig. [2] we show the transverse momentum distributions of the top quark in the same- 
sign top pair production at the LHC with the FCNC couplings mediated by Z boson and 
KK gluon, respectively, assuming Mq{i) = ITeV. Due to the large mass difference, the top 
quarks are typically produced with much higher energy and transverse momentum in KK 
gluon exchange than in Z boson exchange. These properties can be further used to help us 
suppress the SM backgrounds. The total cross sections of the same-sign top pair production 



4 





ITeV 


2TeV 


3TeV 


Eu = 0.5, Ec = 


16.4 


1.71 


0.41 


eu = ec = 0.35 


4.75 


0.48 


0.11 



TABLE I: The total cross sections (in pb) for tt production at the LHC under different values of 
the KK gluon mass and flavor violating parameters, assuming gt^^ = 3gs- 

mediated by KK gluon at the LHC are given in Table [H which shows the total cross section 
can reach as high as 16 pb. 



III. SIGNAL AND BACKGROUNDS 

In order to distinguish our process from the SM ti production, we only consider the 
leptonic decays of the top quarks, pp ^ tt hhl^l^vivi, where I = e or fi. The resulting 
signal consists of two b jets, two positive charged leptons, missing transverse energy and 
possible light jets from showering. We will combine two channels, one of which contains 
exactly one 6-tagged jet in the final state, and the other contains two 6-tagged jets. There are 
several main SM backgrounds for our process: (a) pp W~^ti, W~^W^qq, (b) pp — > W^Zqq, 
when the from Z decay is undetected. Other possible backgrounds like pp —>■ W~^W~^W~ , 
ZZqq, W^bb, tW~{iW~^), and tt are very small according to our calculations, and can be 



neglected. The above backgrounds are simulated with MADEVENT 



events are generated by COMPHEP 4.4 23(]. In our ca. 



22| . and the signal 



culations, PYTHIA 6.4 ^ is used 



251 ] is used for detector simulations, in 



to treat parton showering, hadronization, and PGS4 
which b-tagging efficiency has been taken into account. 

We use the following basic acceptance cuts on jets, leptons and missing transverse mo- 
mentum, 

PtU) >l5GeV, \ri{j)\< 3.0, pt(0 > lOGeV, 
\ri{l)\ < 2.4, ARjj > 0.7, ARji > 0.4, 

ARii > 0.4, > 20GeV, (6) 

where j can be either a light jet or a 6 jet. In order to reduce the backgrounds in which the 
charged lepton comes from b decay, we impose the lepton isolation cuts using PGS4, which 
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Process 


signal (ITeV) 


signal(2TeV) 


signal (3TeV) 


pp W+tt 


pp W^W^qq 


pp — > W~^Zqq 


£u = 0.5, Ec = 


28.5 


3.03 


0.62 


0.022 


0.003 


0.008 


eu = ec = 0.35 


8.2 


0.83 


0.17 


0.022 


0.003 


0.008 



TABLE II: Signal and backgrounds cross sections (in fb) after all the cuts under different values 
of the KK gluon mass and flavor violating parameters, assuming gt^ = Sqs- 

are especially important for suppressing tt backgrounds. 

For the one 6-tagged jet channel, we require the final state containing exactly one 6-tagged 
jet, two positive charged leptons, and at most two light jets. Besides, we further require 

Prijma.) > 20GeV, prib) > 20GeV, Pt(Ux) > 50GeV, 

PT(/mm) > 30GeV, Ht > 300GeV, m{llbj) > 400GeV, (7) 

where we use jmax to stand for the leading light jet, Ht is the sum of transverse energy and 
m{llbj) is the invariant mass of all the leptons and jets. As mentioned before, the final state 
of our signal comes from two almost back-to-back high px top quarks, so the above cuts 
can improve the significance greatly. In order to further reduce the backgrounds, we use the 
following angular cuts, 

A(j)u > 2.2, A0,,_ > 1.0, (8) 

and require at least one combination of the leptons satisfies 

AR,, + AR,j^^^ < 3.0. (9) 

Some of the backgrounds contain one additional W boson which decays to two light jets, so 
we require the light jets invariant mass should not be within the W mass window: 

TTijj < 60GeV or mjj > lOOGeV. (10) 

As for the two 6-tagged jets channel, we require the final state containing two 6-tagged jets, 
two positive charged leptons, and at most one light jet. All the additional cuts can be 
obtained by replacing the leading light jet in the one 6-tagged channel cuts with a b jet. 

Table [TTl shows the total cross sections for the signals and backgrounds with gt^^ = SQs 
after imposing all the cuts. We can see that the total backgrounds can be reduced to 0.03 

6 



fb, while the signal can reach 28 fb and 0.6 fb for Mq{i) = ITeV and 3TeV, respectively. 
To further investigate the LHC reach we show in Fig. [3] and H] the 5a discovery limits of 
Eu and Ec at the LHC, and we see that the LHC can probe an interesting region of e„ and 
Ec for Mq(i) up to 3TeV. Obviously, as mentioned above, our process is sensitive to 
due to the large contribution from the subprocess uu tt, and not for Ec- From Fig. H] 
we find that the discovery limit of Eu can reach 0.1 for gt^^ = 5gs,MQ(i) = ITeV and an 
integrated luminosity of 10fb~^, while the discovery limit of e^ can be as low as 0.06 for 
a high integrated luminosity of 300fb~^. Comparing with the results in Ref. llL ours are 
better for low luminosities and high KK gluon masses. Moreover, unlike Ref. jll], all the 
cuts we imposed are independent of the KK gluon mass and width, which allow us to probe 
the flavor violating parameters for a wide range of gtj^ and Mqh) . 



IV. CONCLUSIONS 



In conclusion, we have studied the production of same-sign top pairs mediated by the 
KK gluon in the RS model with fermions and gauge bosons in the bulk at the LHC. For the 
same-sign dilepton channel, by imposing suitable cuts the backgrounds can be suppressed 
to about 0.03 fb, which can lead to a sizable signal/background ratio, about 5~860. We 
also investigated the LHC reach of the flavor violating parameters and Ec, and found that 
the LHC can probe an interesting region of the parameters even when the KK gluon mass 
is as large as 3 TeV. The discovery limit of Eu can reach 0.1 for gt^^ = 5gs,MQ(i) = ITeV 
and an integrated luminosity of lOfb^^. While for a high integrated luminosity of 300fb^^, 
the discovery limit of Eu can reach as low as 0.06. 
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FIG. 1: Feynman diagram for the same-sign top pair production with FCNC couplings. There is 
also a corresponding u-channel diagram. 
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FIG. 2: Normalized top quark transverse momentum distribution in the same-sign top pair pro- 
duction with FCNC couplings mediated by KK gluon and Z boson at the LHC, assuming = 0.5, 
£c = and Me(i) = ITeV. 
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FIG. 3: 5a discovery limit of e„ and Sc at the LHC for low and high integrated luminosities, 
assuming gtj^ = 3gs. 
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FIG. 4: 5a discovery limit of e„ and Sc at the LHC for low and high integrated luminosities, 
assuming = 5gs. 
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